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smoothness* 

V. Temlyakov ' 

March 3, 2015 


Abstract 

The paper gives a constructive method, based on greedy algo¬ 
rithms, that provides for the classes of functions with small mixed 
smoothness the best possible in the sense of order approximation er¬ 
ror for the m -term approximation with respect to the trigonometric 
system. 


1 Introduction 

The paper is a follow up to the author’s recent paper |16j . The main goal 
of this paper is to extend the results from [16] on m-term trigonometric 
approximation in L p of classes W q of functions with bounded in L q mixed 
derivative of order r to the case of small smoothness r. The most important 
contribution of this paper, alike the paper [16], is that it gives a constructive 
method, based on greedy algorithms, that provides for the classes the 
best possible in the sense of order approximation error cr m (W q ) p . Theory of 
sparse approximation with respect to the trigonometric system has a long and 
interesting history. We give a brief description of this history with emphases 
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put on methods of approximation. We introduce some notation. Denote by 
T := {e lkx }kez the univariate trigonometric system and by T d := T x • • ■ X 
T = {eh k ’ x )} keZ d the multivariate trigonometric system. Dehne best m -term 
approximations for a function 

m 

<r m (f) P ■= inf ||/ - ^ c i ei(kj ' X) Hp 

\ c ji’\ k js ■ | 

and for a class W of functions 


crm(W) p := sup a m (f) p . 

/e w 

We study m-term approximation problems for classes of functions with mixed 
smoothness. We begin with the definition of a smoothness class in the case 
of univariate periodic functions. Let for r > 0 


F r (x) := 1 + 2 ^ k r cos(kx — rn/2) (1.1) 

k=\ 

and 

W r q :={f:f = <p*F r , |M| g <l}. (1.2) 

In the multivariate case for x = (xi,..., Xd) denote 

d 

F r (x) := J]>r-(zy) 

3 = 1 

and 

W ;:={f:f = ip*F r , M|,<1}. 

For feW: we denote /h) := where 95 is such that / = 99 * F r , and dehne 


iw; 


Ibll 


9- 


The hrst results that showed advantage of m-term approximation with 
respect to the univariate trigonometric system T over the classical approx¬ 
imation by the trigonometric polynomials of order m were obtained by Is- 
magilov [6] in 1974. His results were improved by Maiorov [8] in 1986 to the 
relation 

0 m(^ 2 )oo X rfl~ 3/2 . 
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Note, that best approximation of F 2 in the uniform norm by trigonometric 
polynomials of degree m is of order m _1 . Both Ismagilov [6] and Maiorov 
[8] used constructive methods, based on number theoretical results. They 
considered the univariate m-term approximation with respect to T. An in¬ 
teresting phenomenon specific for the multivariate m-term approximation 
was discovered in HU and [12] in 1986. It was established that cr m (Wp p 
decays faster than the Kolmogorov width d m ( W£) p for 1 < q < p < 2. The 
proof of upper bounds for the cr m (W£) p , 1 < q < p <2, r > 2(1 /q — 1/p), in 
m and [12] is constructive. It is based on Theorem 11.61 (see below). The¬ 
orem 11.61 is often used in approximation of classes with mixed smoothness. 
We use it in this paper many times. 

A very interesting and difficult case for the m-term approximation is the 
approximation in L p , p > 2. Makovoz [9] used in 1984 the probabilistic 
Rosenthal inequality for m-term approximation in L p , 2 < p < oo. Later, 
in 1987, Belinskii p] used the Rosenthal inequality technique to prove the 
following lemma. 

Lemma 1.1. Let 2 < p < oo. For any trigonometric polynomial 

n 

t(e n ,x) :=J2 c je ikjX , e n :={kj}] = 1 , 

3 = 1 

and any m<n there exists t(9 m ,x ) with 9 m C 9 n such that 

II t(9 n ,x) -t(9 m ,x)\\ p < C(p)(n/m) 1/2 \\t(9 n ,x)\\ 2 . 

Lemma fTTTI and its multivariate versions were used in a number of papers 
on m-term trigonometric approximation in L p , 2 < p < oo (see, for instance, 
ro and references therein). The use of Lemma 11.11 allowed researchers to 
obtain the right orders of cr m (W) p for different function classes W in L p , 
2 < p < oo. However, this way does not provide a constructive method 
of approximation. Other nonconstructive method for m-term trigonometric 
approximation, which is more powerful than the above discussed probabilis¬ 
tic method was suggested in [3] in 1995. The method in [3] is based on a 
nonconstructive result from finite dimensional geometry due to Gluskin |5j. 

Breakthrough results in constructive m-term approximation were ob¬ 
tained by application of general theory of greedy approximation in Banach 
spaces. It is pointed out in |4) (2002) that the Weak Chebyshev Greedy 
Algorithm provides a constructive proof of the inequality 

cr m (f) P < C(p)m- 1/2 \\f\\ A , p e [2, oo). 
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Here 


ll/IU:=£l/(k)l, /( k)-.= (2w)- d f(x)e-‘^dx. 

k Jjd 

In [13] (2005) a constructive proof, based on the Weak Chebyshev Greedy 
Algorithm, was given for the following inequality 

<7m(f )oo < log(l + N/m)) 1/2 \\f\\ A , 

under assumption that / is a trigonometric polynomial of order N. 

The following Theorem 11.11 is from [16] . We use it in this paper. Let 

n(N ,d) := {(ai,..., a d ) G l d : |a,| < Nj, j = 1,... ,d}, 

where Nj are nonnegative integers and N := (N \,..., Nf). We denote 

T(N,d):={t:t= c k e i(k ’ x) }. 

ken(N,d) 

Then 

d 

dimT(N, d) = JJ(27Vj + 1) =: tf(N). 

3 =1 

For a nonnegative integer m denote fh := max(m, 1). 

Theorem 1.1. There exist constructive greedy-type approximation methods 
which provide m-term polynomials with respect to T d with the follow¬ 
ing properties: for 2 < p < oo 

11/ - CT„(/)I| P < C 1 (d)(m)- 1/ ¥ /2 ||/IU, ||GS,(/)|U < C 2 (d)||/|U, (1.3) 

and for p = oo, f G T(N, d) 

ll/-G~(/)|U<C 3 (<i)(m)- 1 / 2 (lntf(N)) 1/ 2||/|| J , ||G“(/)|U < G.MII/IU. 

(1.4) 

We now formulate the main results of the paper. The main results of the 
paper are in Section 3, where we consider m-term approximation in L p with 
p G (2, oo). Here is a typical result from Section 3. 

Theorem 1.2. Let 1 < q <2 < p < oo and /3p' < r < 1/q. Then we have 
^ m (Wp p x m -h-^W 2 (io gm )G- 1)( dr-i)-/3p ) . 

The upper bounds are achieved by a constructive greedy-type algorithm. 
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Theorem 11.21 complements the known result from |l(jj for large smooth¬ 
ness: Let l<q<2<p<oo and r > 1/q. Then we have 

a m (Wp p x m-^logm)^" 1 )^). 

The upper bounds are achieved by a constructive greedy-type algorithm. 

In Section 3 we also consider the case r = 1/q and more general smooth¬ 
ness classes W“’ 6 , which we define momentarily. We introduce some more 
notations. Let s = (si,..., s<j) be a vector whose coordinates are nonnegative 
integers 

p( s) := {kez': [2-i- 1 ] < |fcj| < 2*>, j = 1,... ,d}, 

Qn U|| s || 1 <nP( s ) - a step hyperbolic cross, 

d 

T (N) := {k 6 max(| kj \, l) < IV}• - a hyperbolic cross. 

j = 1 

For / e Li(T d ) 

kep(s) 

Let G be a finite set of points in Z d , we denote 

T(G) := |t:t(x) = ^c k e 8 ( k ’ x ) 

l kgG 

For the sake of simplicity we shall write T(r(IV)) = T(N). 

Along with classes dehned above it is natural to consider some more 
general classes. We proceed to the definition of these classes. 

Define for f £ Li 

fi:= N 0 :=NU{0}. 

||s||l=Z 

Consider the class 

W“’ fe := {f ■.\\f l \\ q <2- al {l)^ b }. 

Define 

ll/llw;-* -= SU P 

q l 
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It is well known that the class W£ is embedded in the class W^' 0 . Classes 
W“’ 6 provide control of smoothness at two scales: a controls the power type 
smoothness and b controls the logarithmic scale smoothness. Similar classes 
with the power and logarithmic scales of smoothness are studied in the recent 
book of Triebel m 

In Section 2 we discuss the case 1 < q < p < 2. We use the technique 
developed in mi and [12]. The main results of Section 2 are the following 
two theorems. We use the notation (3 := (3(q,p) := 1/q — 1/p and p := 

v ( q ) : = 1/9-1/2. 

Theorem 1.3. Let 1 < q < p < 2. We have 

( m~ a+ P (logm)^ _1 ^“ +6_2 ^, a > 2/3, 
cr m (W“’ 6 )p x < rn _a+/3 (logrn)( d_1 ) 6 , (3 < a < 2/3, 

y m _ ^(logm)^ _1 ^(loglogm) 1 / 9 , a = 2/3. 

Theorem 1.4. Let 1 < q < p < 2, r > (3. We have 

cT m ( wp p X m~ r+ ^{logm )( rf - 1 )( r - 2 ^)+. 

In the case r > 2(3 Theorem 11.41 is proved in [TT] and [12] and, as it 
is pointed out in in. in the case (3 < r < 2/3 the order of cr m (Wp p is 
obtained in [2], We present a detailed proof of Theorem 11.41 in Section 2 for 
completeness (for instance, the author could not find the paper [2]). 

We formulate some known results from harmonic analysis and from the 
hyperbolic cross approximation theory, which will be used in our analysis. 


Theorem 1.5. Let 1 < p < 00 . There exist positive constants C\{p,d) and 
C 2 {p, d), which may depend on p and d, such that for each f G L p 


Ci( P ,d)\\f\\ p < 



<C 2 (p,d)\\f\\ p . 


Corollary 1.1. Let G be a finite set of indices s and let the operator So map 
a function f e L p to a function 


Sa(f)--=Y.W 

sGG 


Then for 1 < p < 00 


\\S G (f)\\ p <C( P ,d)\\f\\ p . 
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Corollary 1.2. Let 1 < p < oo. Denote p* := max(p, 2) andp* := min(p, 2). 
Then for f £ L p we have 


i !v* 


i/p* 


C 3 (p, <0 s.(/)ll{ 


— IIJ lip 


<c.fe«0 5>(/)ll 


We now proceed to the problem of estimating ||/|| p in terms of the array 
{||h s (/)|| g }. ffere and below p and q are scalars such that 1 < q,p < oo. 
Let an array e = {e s } be given, where £ s > 0, s = (si,..., sf), and Sj are 
nonnegative integers, j = 1 We denote by G(e,q) and F(e,q ) the 

following sets of functions (1 < q < oo): 


G(e,q) := {/ G L q : ||^ s (/)|| g < £ s for all s}, 


F(e,q) := {/ G L q : ||^ s (/)|| g > £ s for all s}. 

The following theorem is from [12], p.29. For the special case q = 2 see 
[ 1T| and [12], p.86. 

Theorem 1.6. The following relations hold: 

4 i/p 

sup ll/llp- iE ,; J 2 " a " 1(p/, " 1) ' 

f£G(e,g) \ s 


1 < q < p < oo; (1.5) 


inf 

/GF(e l9 ) 


E ^ 2 " 


i/p 


s||i(p/g-i) 


1 < p < q < oo, (1.6) 


with constants independent of e. 

We will need a corollary of Theorem 11.61 (see [T2], Ch.l, Theorem 2.2), 
which we formulate as a theorem. 


Theorem 1.7. Let 1 < q < 2. For any t 6 F(N) we have 

ll«IU:=El‘(k)l <C'fe<i)iV 1 /« ( logiV)(' < - 1 »< 1 - 1 /«)||(|| 5 . 

k 

The following Nikol’skii type inequalities are from [T2] . Chapter 1, Section 

2 . 


Theorem 1.8. Let 1 < q < p < oo. For any t e 'T(N) we have 


II^IIp < C{q,p,d)N^\\t\\ q , f3 = l/q-l/p. 
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2 The case 1 < q < p < 2 


Proof of Theorem 11.31 In the case 1 < q = p < 2 the upper bounds 
follow from approximation by partial sums The corresponding lower 

bounds follow from the proof of the lower bounds of Theorem 2.1 from [12], 
Chapter 4. We now assume that (3 > 0. The case a > 2/3 in Theorem 11,31 
which corresponds to the first line, was proved for classes in [11] (see 
also [12], Cli.4). In that proof assumption / G W£ was used to claim that 
ll/ill, <C 2~ rl , which means ||/|| w o,o < oo. Thus, that proof gives the required 
upper bound for the class W“’°. That same proof gives the corresponding 
upper bound for the class for all b. The proofs from HH and [12] are 

constructive. 

Consider now the case f3 < a < 2/3. The proof of upper bounds in 
this case uses the ideas from CH and [12]. Take an n G N and include in 
approximation the 

SqM):= Y. W)- 

s:|| s ||i<n 

Choose N such that 

2 n x 2 n n d ~ 1 


and for l G (n, IV] include in the approximation mi blocks S s (f), ||s||x = l, 
with largest ||<5 s (/)|| p . Denote this set of indices s by Gi. Then by Theorem 
11.61 and the assumption / G W“’ 6 we obtain 

( Y ll<5.(/)ll? 2_ " 5 ‘'^ « ll/ill, < (2.1) 

ys:||s||i=( J 

We now need the following well known simple lemma (see, for instance, [12] . 
P-92). 


Lemma 2.1. Let a\ > <22 > • • • > Om > 0 and 1 < q < p < 00 . 
m < M one has 

/ m \ 1 / p / m \ l / q 

(Y<) - 

\k=m J \ k=l J 

Applying Lemma [2711 to {||<5 S (/)|| P } we obtain 


1 /p 


E 


ii4(/)iip 


||i=i,s^Gi 


Then for all 


< ( m , + i )-/*2 


( 2 . 2 ) 





Next, using the Corollarv ll.2l of the Littlewood-Paley theorem we derive from 

m 


i/p 


E W)IIp«( E IIW)IIS « 

s:||s||i=Z,s^Gi f 

(2.3) 


s:||s||i=Z,s^Gi 

Denote _ 

/,' := E W)- 

s:||s||i=Z,s^Gi 

Let k, > 0 be such that a — f3 < n/3 < f3. Specify 

rrn := [2 K(JV - ;) ]. 


Then (j2.3[) implies 


II //Up < ( mi + l)- /3 2- (a - /3) ^ (d - 1)b < 2-( a -P )N N( d ~ 1)b . (2.4) 

n<l<N n<l<N 

The approximant 

A m (!)-.= s Q ,xf)+ E E -*■(/) 

n<l<N s:||s||i=Z,s^G; 


has at most m terms 


m < \Q n \ + < 2* (2-5) 

n<l<N 

By Theorem 11.81 we have 

ii E/'iif« E ii/'iip« E ii/iiA'« 2 -(-w'w'-i* ( 2 . 6 ) 

Z>V Z>JV Z>V 

Combining (j2.4|) with (12.611 and taking into account (j2.5j) we obtain 
11/ - 4n(/)||p < m -(“-«(logm) 6(d_1) . 

This completes the proof of upper bounds in the case /3 < a < 2/3. 

We now proceed to the case a = 2/3. We begin with the upper bounds. 
The proof is as in the above case (3 < a < 2/3. As above, we choose N such 
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that 2 n x 2 n n d ~ 1 . Then N — n x logn. For l £ (n, N] set mi = 2 N ~ l . Then 
as above 

rn -C | Qn | + ^ 2 l mi <C 2^ (IV - n). (2.7) 

n<l<N 

In the same way as (I2.6[) was established we get 


X>l|p « E IIZ-llp « E Mlt 2 ' 3 ' « (2.8) 

z>tv z>iv z>tv 


By (12.3p we have 

||//||p « (m, + 


and 


5 ] //Up « 

n<l<N 



1/p 


•c 


£ ((m, + i)-^2-^Z( d - 1 > 6 ) P « 2-^iV( d - 1 ) b (iV 


\n<l<N 


(2.9) 


n) 1/lp . (2.10) 


Relations (12.71) . (12. 8p and (12.101) imply the required upper bound. 

We now prove the lower bounds in the case a = 2/3. Let N be as above. 
For l £ (n,IV] choose an arbitrary set Bi of s such that ||s||i = l and \Bi\ = 
mi := 2 N ~ l . Consider / such that fi = 0 for l (f (n, N] and for l £ (n, N] 


ft := 2-W +l - 1 /^ l l {d - l)b m~ 1,q ei(k ’ X) - 

sGBi kGp(s) 


Then 




and therefore ||/|| w 2 ,s ,6 -C 1. We prove the lower bound for the a m (f) p with 
m < 2 N (N — ri)/ 8. Let K m := {k J }™ =1 be given. Denote 


L := {l £ (n, N] : \K m D U seBi p(s)| < 2^/4}. 


Then 

which implies 


(. N-n- \L\)2 N /A <m< 2 N (N - n)/ 8, 
\L\ > (N-n)/ 2. 
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Take l G L. Denote 


K l m := K m n U seSi p(s) 

and 

B'r-= {seB,:Knp(s)|<|p(s)|/2}. 

As above we derive that 

\B[\ > |B,|/2. 

Let g be any polynomial of the form 


g= Y c k ei(k,x) - 

k G-Z^m 


By Theorem 11.61 we get 


i/p 


ii/—A » E 5L di'5,(/-9)ii'22 ,<i/2 - i/ ^) 1 

\n<l<N s £Bi 

1 tv 

» (ee(h«/- 9 )ii^- i d' 

y l&L S &B[ 

> (EE ^2-(2/3+i-i/g)/^(d-i)fe 2 -(A r -0/g2h 2 2 / ( 1 / 2 -i/p)) p 

l£.L 

> 2~P N N (d ~ 1)b \L\ 1/p > 2~P N N < ' d ~ 1)b (N - n) l/p . 


i /p 


Taking into account that 2 N x 2 n n d ~ 1 and m < 2 n (N — n)/8 we complete 
the proof of lower bounds. 

Proof of Theorem II.41 In the case r ^ 2/3 the upper bounds in Theorem 
11.41 follow from Theorem [L3] by the embedding of WJ into W^’ 0 . It turns out 
that in the case r = 2/3 the above way does not give a sharp upper bound. 
We now proof the corresponding upper bound in the case r = 2/3. We begin 
with an analog of Lemma 12.11 


Lemma 2.2. Let {'Wj}jL 1 be a set of positive weights. Let a x > a 2 > • • • > 
O’M A 0 and 1 < q < p < oo. Then for all m < M one has 
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Proof. Monotonicity of {ctfc}££ x implies 

m M 

a rn Z Wk ~ Z a k Wk ’ 

/c=l fc=l 

and 

( m \ -1/9 / M 

E Wfc ) I Z a k W k 

k =1 / \fc=l 

Therefore, 

( M \ 1 / p / M \ Up / m \-P/M 

Z a k wk - a ™~ q)/p Z a k wk ^ ZZ a<kWk 

k=m / \k=m / \ k=l / \ k=l 

□ 




We now prove the upper bound in the case r = 2/3. Let n £ N and, 
as above, N be such that 2 N x 2 n n d ~ 1 . For f £ W’ } we include in the 
approximation SQ n (f) and approximate 


9-=g(f)-= Z W)> A ( n i N ) '■= I s ; n < INK < N }- 

s€A(n,N) 


Using Theorem 11.61 we obtain 


1/9 


E (2' J| " I|I II«/)II,)‘ 

seA(n,N) 


«imiwj. 


( 2 . 11 ) 


We want to apply Lemma |2.2| Consider {u s } se A(n n), v s ■= ||5.(/)||p2-Hx/i» 
with weights w s := 2^. Then (I2TTD gives 


1/9 


E 

, sEA(n,7V) 


V%W S 


< / w; 


Choose k largest v s and denote the corresponding set of indices s by G(k). 
By Lemma [2.21 we obtain from the above estimate 


i /p 


-3 


Z v * w * < z 


IV s 


w r • 

q 


( 2 . 12 ) 


, seA(n,iV)\G(fc) 


,s eG(fc) 
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By the Corollary 11.21 to the Littlewood-Paley Theorem we find 


E w)iip« 

sgA (n,N)\G(k) 


1/p 


.sgA (n,N)\G(k) 


II4(/)II? 


(2.13) 


Combining (j2.13j) with (I2.12p we obtain 

i/p 

E ll«/)ll!' 


i Ip 


.sgA (n,N)\G(k) 


v * Ws 

, sgA (n,N)\G(k) 


Choose k such that 


-P 




E 

.sg G(k) 




2 n < < 2N+1 - 
sg G(fe) 


(2.14) 


In this way we have constructed an m -term approximation of / with m -C 2 W 
and error 

ll/-S«,(/)- E <5.(/)ll P «2-' JJV «m-' i . 

sgG(fc) 

The upper bounds in Theorem 11.41 are proved. 

The lower bounds in the case r > 2/3 are proved in [12]. The lower bounds 
in the case j3 < r < 2(3 follow from the univariate case. 


3 The case 1<(/<2 <£><oo 

The main goal of this section is to prove Theorem 11.21 from the Introduction. 
We reformulate it here for convenience. 

Theorem 3.1. Let 1 < q <2 < p < oo and ftp' < r < 1/q. Then we have 

(T m { WJ)p X m -(r-P)p/2^ ogm ^d-l)(r(p-l)^p) 

The upper bounds are achieved by a constructive greedy-type algorithm. 
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Proof. We will prove the upper bounds for a wider class WJ’°. Let / G W£’°. 
Let n G N. We build an m-term approximation with m = 2\Q n \ x 2 n n d ~ l . 
We include in the approximation Sq n (f). We split the remainder function 
into two functions 

/ - S Qn {f) = gA + go- 

We use Theorem 11.11 to approximate gA and approximate g 0 by 0. We now 
describe a construction of g^. First, we choose N G (n,Cn], C = C(p,d), 
which will be specified later on, and include in the gA the 

9a ■= & 

n<l<N 

Then by Theorem 11.71 we have 

IlsilU = E limu « E l|/iL 2 ,/ n l ‘ , - 1 > (1 - 1/ ’> 

n<l<N n<l<N 


< E 2 l(l/q-r)i( d ~l)(l-l/q) ^ ^ N(1/q-r) jy(d-l)(l-l/q) . ("3 ^ 

n<l<N 

Next, for l > N define 

u t ■= [n d - l 2^ N ~ l) ] 

with ft satisfying 

1 In — r r — 6 

-x < ft < —-—. 

1 - 1 /? P 

Such ft exists because our assumption r > f3p' is equivalent to the inequality 


l/q — r r — /3 

T^TTq < ~ 


Denote G(l) the set of indices s, ||s||i = l, of cardinality |G(Z)| = tq, with 
largest ||<5 S (/;) || 2 . Second, we include in gA the 


9a ; = Yl 6s (/')• 

1>N seG{l) 


It is clear that there is only finite number of nonzero terms in the above sum. 
We have 


\\ a\\a = E 

1>N 


E 4(/ I )iu«Eii/'iiE , |G'(/)i 1 - i -'« 

s£G(1) 1>N 
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<C 2^D9-B n ( rf -i)(i-i/9)2 K ( Ar -0(i-i/9) 
1>N 

<g- n ( rf - i )( i - i /<?)2 K7v ( i “ i / , j) 2^ 1 / g ~ r ~ Ac ^ 1 ~ 1//g ^. 


Z>iV 


By our choice of k we have 1/q — r — /c(l — 1/q) < 0 and, therefore, we 
continue 

jy( rf - 1 )( 1 - 1 /9)2 Ar ( 1 /9 _r ). 


By Theorem 11.11 we obtain 

|| 9A - G p m/2 {g A ) || p « m -l /2 N (d-l)(l-l/ q ) 2 N(l/ q -r)_ 

We now bound the ||g 0 ||p- Denote 


f° -=fi- £ «/a 

seG(0 


By Theorem 11.61 we get 


1/9 


E (ll^(/z)ll22 l|s||l(1/2 - 1/f?) ) 9 ) «2- H 


l|s|li=Z 


and 


1/9 


£ IIWOlls «2 , <-' +1 /«- 1 / 2 >. 


11 s 11 1 —/ 


By Lemma [2. II we obtain 


i/p 


E IIW0II2 ) « (Ul + l)^2 Z ^+l/9-l/2). 

. sgG(Z) 


By Theorem 11.61 we get from here 


i/p 


(3.2) 

(3.3) 


ll/,”ll P «( £ (l|i,(/,)ll22 l|,|l ‘< 1 / 2 - 1/ - ) ) P ) « + I)"'*. 

, s^G(Z) 
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Thus 


im p <Eh/°ii»«E 2 

1>N 1>N 


{r-P)l n -P{d-l) 2 ~Pk(N-1) 


^ n -p{d-i) 2 -^N ^2 2-( r -P-P K ) 1 . 

1>N 

By our choice of k we have r — /3 — /3k > 0. Therefore, (13.41) gives 

We now choose N from the condition 


2 ( 1 /9-OA r n (rf-l)(l-l/'?) m -l/2 x 2 -h-/ 3 ) Ar n -/ 3 ( rf - 1 ) 


(3.4) 


(3.5) 


This is equivalent to 

2 n x 2 n P/ 2 7i( d-1 )( 1- p/ 2 ) 

or in terms of m 

2 n x m p/2 (logm) (d - 1)(1 - p) . (3.6) 

As a result it gives us the following upper bound for the error of approxima¬ 
tion 

11/ - SqM) - GI, 2 (Sa) II, « 2-^ N n-^ d -» 

< m~ {r ^ )p/2 (log m) . 

This completes the proof of upper bounds. 

We proceed to the lower bounds. For a given m chose N as in (13.61) . 
Consider the function 

<?( x ) : = E E e ‘ (k,x) = E ei(k ' x) ’ A Qn-=Qn\Qn-i. 

||s|| i =7V kGp(s) keAQjv 

It is known that 


\\g\\ q x 2 ^(i-i/ 9 ) iV C-i)/ 9) 1 < q < oo. (3.7) 

We now estimate the a m (g) p from below. Take any set K m of m frequencies 
k. Consider an additional function 

A(x) := V e^ kx / 

keA QN\Km 


16 




For any polynomial t with frequencies from K m we have 


(g ~t,h) <\\g -t\\ p \\h\\ p/ (3.8) 

and _ 

{g -t,h) = (g,h) = 1 = \AQ N \ K m \. (3.9) 

keA Qi^\Km 

From our choice (13.61) of N it is clear that asymptotically 
|A Q n \ K m \ > IAQjvI - m > 2 N N d ~\ 

Next, we have 

11%' < 11%' + h ~ h\\ P > < \\g\\ P ' + ||g - h\\ 2 

« 2 N/p N (d-l)/p' + m l/2 <<; m l/2 

Thus, (13.8p and (j3.9[) yield 

a m(g)p » 2 N N d ~ 1 m~ 1 / 2 . 

We have from (13.71) 

|%)|| g < 2 N{r+l - l/q) N {d ~ 1)/q . 

Therefore 

<x m (W r q ) p > 2 N{1/q - r) N (d - 1) ( 1 - 1/q) m~ 1/2 
x m -h-«p/ 2 (log m ) . 

This proves the lower bounds. 

□ 

The above proof of Theorem 13.11 gives the right order of cr m (W“ ,6 ) p for 
/3p' < a < 1/q and all b. We formulate this as a theorem. 

Theorem 3.2. Let l<q<2<p<oo and /3p' < a < 1/q. Then we have 

<7 m (W“’ b ) p X m -MW2(l ogm )(<i- 1) (Ha( P -l)-W > 

The upper bounds are achieved by a constructive greedy-type algorithm. 
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For / G WJ>° one has for r > f3 

II E /‘Hr 5 E II/* « E H/'llr 2 ' 3 ' « 2-^ N . (3.10) 

1>N 1>N 1>N 

In the proof of Theorem 13. II we constructed g\ and go- It resulted in a better 
error estimate of the m-term approximation of the tail Y2i>n fi than the 
simple bound (13. 10[i . We got the error <C 2~^ r ~^ N n~^ d ~ 1 \ We obtain the 
same improvement of the error if, in addition to the assumption / G WJ’°, 
we assume that / G For / G we have 

\\J2fiWp < 2-( r ~P )N N-^-V. 

1>N 

We formulate a theorem, which follows from the proof of Theorem 13.11 
Theorem 3.3. Let l<q<2<p<oo and (3 < a < 1 jq. Then we have 
a m (W a q b n W a ~^) p x m -(^)r/2( logm )(d-i)(6+a(r-i)-/3r)_ 

The upper bounds are achieved by a constructive greedy-type algorithm. 

We note that the class TT q (see the definition in Section 5), 1 < q < 2, is 
embedded into the class fl W p ~ l3 ’ b ~ 13 with b = 1/q. This follows from 
Corollary 11.21 and Theorem 11.61 The following theorem holds. 

Theorem 3.4. Let l<q<2<p<oo and (3 < a < 1/q. Then we have 

<J m (W q ) p X 777,-6—(log m ) (d-\)(\/q+r{p-\)-Pp ). 

The upper bounds are achieved by a constructive greedy-type algorithm. 

The order of cr m (H' ; ) p is known (see Romanyuk [10]). However, the cor¬ 
responding upper bounds in [10] are proved by a nonconstructive method of 
approximation. 

We now proceed to the case a = 1/q. 

Theorem 3.5. Let 1 < q <2 < p < oo and a = 1/q. Then we have 

Vm(Wl /q ’ b ) p X m -1 / 2 (log 777) (d “ 1)(6+1 “ 1/ 'b +1 . 

The upper bounds are achieved by a constructive greedy-type algorithm. 
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Proof. The proof goes along the lines of the proof of Theorem 13.11 We use 
the same notation as above. We begin with the upper bounds. In the case 
a — l/q the bound (13.11) reads 

II^IU < (N — n)N {d ~ 1){b+1 - 1/q) . (3.11) 

We repeat the argument from the proof of Theorem 13.11 for g\ and go with 
k E (0, (a — /3)//3). It gives 

||^IU<iV (d " 1)(b+1 ” 1/9) , (3.12) 

Ilsollp < 2- (a - /3)Ar n (b ^ )(d - 1) . (3.13) 

Choosing N from (13.61) we obtain 

11/ - S Q ,(f) - G^t&Ollp « (JV - 

<C m _1/2 (logm) (d_1)(6+1_1/,?)+1 . 

This completes the proof of upper bounds. 

We proceed to the lower bounds. For a given m chose N as in (13.61) . 
Consider the function 

g(x) := e i(k ’ x) , AQ, := 

n<l<N kEAQj 

Then ||#|| w i/^ < 1. 

We now estimate the o’ m (g) p from below. Take any set K m of m frequen¬ 
cies k. Consider an additional function 

A(x) := ^ 

k<EA(n,N)\K m 

For any polynomial t with frequencies from K m we have 

(g-t,h) < \\g-t\\ p \\h\\ p , (3.14) 

and 

(g -t,h) = (g,h) = <K k ). ( 3 - 15 ) 

kgA {n,N)\K m 
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From our choice (13.61) of N it is clear that asymptotically 

g{ k) > (N - n )iV (d - 1)(fe+1 - 1/9) . 

keA{n,N)\Km 

Next, we have 

WHp’ < WaWp' + Ilf 1 - h \\p' < h\\ P ' + Ilf 7 - h\\ 2 
< 2 N /PN( d ~ 1)/p ' + m 1/2 < m 1/2 . 

Thus, (13.14(1 and (13.15(1 yield 

a m (g) p > (N - n)N {d - 1){b+1 - 1/q) m- 1/2 . 

Therefore 

a m (Wj /9 ’ b )p > (N - n)N {d - 1)ib+1 - 1/q) m~ 1/2 
xm-^gogm)^ 1 )^ 1 - 1 ^ 1 . 

This proves the lower bounds. 

□ 

The above proof of Theorem 13.51 can be adjusted to prove the following 
results for the W^ 9 classes. 

Theorem 3.6. Let 1 < q < 2 < p < oo. Then we have 
<UWj/*) p x m-^logm)* 1 - 1 ^. 

The upper bounds are achieved by a constructive greedy-type algorithm. 

Proof. We need the following analog of Theorem 11.71 
Lemma 3.1. For t G T(A(n, IV)) tee have for 1 < q < 2 

||i|U « - n) 1 - 1/ »||t|| w i/ a . 

Proof. Let r — 1/q and 

t — (p * F r , \\p\\ q = ||t|| W ;- 
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Then 


U< 


E e k^r(k)f 


,»(k,x) 


keA (n,N) 


|e k | = i. 


(3.16) 


Using Theorem 11.61 with parameters q' and 2 we obtain 


E ^(k)^ 

kGA (n,N) 


( ' \ 1/q ' 

< E (2- lr 2 l/2 2 l{1/2 ~ 1/q,) y l d ~ l ) < (N - n) 1/q 'N {d ~ 1)lq '. (3.17) 

\n<l<N ) 

Combining (13. 16[) and (I3.17P we complete the proof of Lemma 13.11 

□ 


We return to the proof of Theorem 13.61 The proof goes along the lines 
of the proof of Theorem 13.51 We use the same notation as above. We begin 
with the upper bounds. In our case Lemma 13.11 implies the following analog 
of the bound (13. lip 

HaWa C(N- n )i-i/?7v( d - 1 )( 1 - 1 /«). (3.18) 

Choosing N from (13.6p we obtain 

11/ - S Qn (f) - G’ m /2 Gm)IIp « (N - 

« mW 2 (l ogm )<“-i)a-i/i>+i-i/i = m-‘ 22 (logm)' , ( 1 - 1 /«>. 

This completes the proof of upper bounds. 

The lower bounds follow from the same example (with 6 = 0) that was 
used in the proof of Theorem 13.51 In this case instead of ||g|| w i/ 9 ,o < 1 we 
have 

llsllwy. « (AT - n) 1 '* 

which brings the bound 

u m (Wj /9 ) p » (N - n) 1-1/9 JV (d “ 1)(1_1/?) m _1/2 

x ruT 1 / 2 (log m)^ 1-1 ^. 

This proves the lower bounds. 

□ 
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4 The case q = 1 

We begin with the case 2 < p < oo. 

Theorem 4.1. For any e > 0 we have for 2 < p < oo 

{ m -a+ 1 / 2 (iog m )(rf- 1 )(a- 1 +fe)+e^ a > 1, 

m-( a - /3 ) p / 2 (logm)( d_1 ) 6+e , /3 < a < 1, f3 = 1 — 1/p, 

m _1 / 2 (logm)^ _1 ^ +1+e , a = 1, 

with constants in -C allowed to depend on e, d, and p. 

The upper bounds are achieved by a constructive greedy-type algorithm. 

Proof. For large smoothness a > 1 the following lemma from [T6] plays the 
key role in the proof. 

Lemma 4.1. Define for f G L\ 

fi'.= W), N 0 :=NU{0}. 

IMIi =i 

Consider the class 


W“’ b := {f:\\fi\\ A <2- al (jy d -V b }. 

Then for 2 < p < oo and 0 < p < a there is a constructive method A m (-,p , p) 
based on greedy algorithms, which provides the bound for f G W^’ 6 

11/- A m (f,p,p)\\ p <C m“ a “ 1/2 (logm) (d_1)(a+fc) , 2 < p < oo, (4.1) 

We also need the following version of Theorem 11.71 in the case q = 1 (see 
[12], Chapter 1, Section 2). 

Lemma 4.2. For any e > 0 there is C(e, d) such that for each t G 7 ~{N) we 
have 

\\t\\ A <Cfe,d)N(\ogNY\\t\\ l . 

Let / G W“’ b , a > 1. By Lemma 14.21 we get 

\\fi\\ A ^ 2 ” z(a - 1) / fe(d - 1)+e 

with a constant in <C allowed to depend on e and d. Setting 6(e) := b + e/(d — 
1), we obtain 

ll/llw 0-1 ’^ ^ 

v A 
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Lemma 14.11 gives a constructive proof of 


M/) P « m _a+1//2 (log m) ( d - 1 )( a - 1+6 )+ e . 

This proves the first inequality in Theorem 14.11 

Consider now the case (3 < a < 1. The argument in this case is close to 
the proof of Theorem 13.11 We use the same notations. We now define 

9a'= Yj fu 9o := Y fi- 

n<l<N 1>N 

By Lemma [4.21 we get 

\\g A \\ A < Y 2 l(1 - a) l b(d ~ 1)+e < 2 N{1 - a) N b ( d ~ 1)+e . (4.2) 

n<l<N 

By Theorem 1 1.1 1 we obtain 

am{g A ) P < m -V2 2 N (l-a) N b (d-l)+e_ (4.3) 

By Theorem 11.81 

INI, < V II/,II, < V ||/ I || 1 2' S ‘ « 2(4.4) 

1>N 1>N 

Close N such that 

m - 1 / 2 2 Ar ( 1_a ) x 2 _ ( a_ ^ 7V , 

that is 

2 n x m p/2 . (4.5) 

This gives the error bound 

a m {f) p < m~^ a ~^ p / 2 (log m) b( ' d ~ 1 ' >+e . 

This proves the required bound in the second case. 

In the case a = 1 we get as in (14.2p 

I MU < N b(d ~ i)+i +e . 


Choosing N from (14.5[) we obtain 


(Tm(f)p < m- 1/2 (logm) 6(d - 1)+1+e . 
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This completes the proof of Theorem 14.11 

We note that in the case a < 1 the corresponding lower bounds with e = 0 
follow from the univariate case (see HD- We now prove the lower bounds for 
a > 1. It is sufficient to prove them for p = 2. Let m be given and n be such 
that 2 n n d ~ 1 x m and m < c(d)\AQ n \ with small enough c(d) > 0. Let 

K n {x) := ( X “ \k\/N)e ikx = (i sm(Nx/2 )) 2 / (Ar(sin(o;/2)) 2 ) 

|fc|<7V 

be a univariate Fejer kernel. The Fejer kernel /Cjy is an even nonnegative 
trigonometric polynomial in T(N — 1). In the multivariate case define 

d 

/C N (x) =H JC Nj ( Xj ), N = (N 1 ,...,N d ). 

3 = 1 

Then the /Cn are nonnegative trigonometric polynomials from T(N — 1 ,d) 
which have the following property: 

II || i = 1- (4.6) 

Consider the function 

^( x ) : = ^ 2 s - 2 ( x )e l(2S ~ 2 *~ 2 ,x) . 


Then by (14.6[) 

IMIi « n<1 ~ 1 ■ (4.7) 

Take any set K m of m frequencies. It is clear that for small enough c(d) we 
have 

Pm(g)l> IM k )| 2 » \AQ n \. (4.8) 

kGA Q n \K m 

Relations (14.71) and (|4.8[) imply 

^m(W“’ 6 ) 2 > 2 n ( 1 /2-a) n -C-l)/2+b(d-l) x m -“+V 2 ( lo g m ) (d-l)(b+a-l) _ 


□ 

Consider now the case g = l,l<p<2. We need a version of the relation 
(11.61) from Theorem 11.61 adjusted to our case. 
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Lemma 4.3. Let 1 < p < oo. For any e > 0 there exists a constant C (e, d,p) 
such that for each t G T(Q n ) we have 


Y IIWIIp < C{e,d,p)n e 2 fin \\t\\ u 0 = 1-1 /p. 

||s||i <n 

Proof. Choose v G (l,p) such that v' := v/(v — 1) > d/e. By the Holder 
inequality and Theorem 11.61 we get 


1/v' 


1/v 


E n^wiip < 


E 1 E ii^wn 


|| s ||i<n 


||s||i<n / \|| s l|i^ n 

< n e 2 n(l/v-l/p) l ^ ||5 s (t)||^2 | l s||l(1/p - 1/ ^ ) <n £ 2 n ( 1 /*- 1 /p)| 

\IM|i<n ) 

By Theorem 11.81 continue 

< n e 2 n ( 1 /^- 1 /p)2"( 1_1 /' u )Utlli = n e 2^||t||i. 


□ 


Theorem 4.2. Let 1 < p < 2. Tor any e > 0 we have 


a m (W“’ 6 ) p « 


m “ +/3 (logm)^ 1 h“+ 6 2 / ? )+ e ) a > 2/3, 

m -a+/3 (log m ) (d-l)6+e ^ (3 < a < 2/3. 


Proof. We begin with the case of large smoothness. Let / G W“’ fe , a > 2/3. 
Then by Lemma [4.31 


Y ll^(/0llp « 2- ( “-^ )z Z fo(d - 1)+e . (4.9) 


As in the proof of Theorem II .31 from Section 2 denote by Gi the set of indices 
s with mi largest ||<5 s (/z)||p- Then by Corollary 11.21 and Lemma \TJ\ we obtain 
for 

/; - E wo, 

S^G; 


1/p 


Il//llp< 


EIIWOII! 
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(4.10) 


« ( m i + I) - * 3 E ll'S.(/ I )ll r <(n> i + l)-' , 2 

Set for l > n 


||s||i =1 


mi := [2-< l - n) n d ~ 1 }, 

where k > 1 is such that a > (1 + k)/3. We define the m -term approximant 


An(f) := SqM) + E E Wi)- 

Z>n seGi 


Then 


m 


< it?„i + e 2im; ^ 1 ■ 


(4.11) 


l>n 


For the error of approximation we obtain from (j4. lOj) 


||/ - A m (f)\\ p < E ll/;ilp « (4.12) 

l>n 

Relations (14.lip and (14. 12)1 imply the required upper bound. 

In the case /3 < a < 2/3 the proof repeats the corresponding argument 
from the proof of Theorem 11.31 in Section 2. Instead of (12.11) we use (14.9p . 
Also, in the case a = 2/3 the factor log log m is included in (logm) e . 

The lower bounds with e = 0 in the case of small smoothness a < 2/3 
follow from the univariate case. We now consider the case of large smoothness 
a > 2/3. In the case p = 2 it is proved in the proof of Theorem 14.11 We use 
the same example to prove the lower bounds for p <2. Instead of (j4.8j) by 
Theorem 11.61 we obtain 

a m (<7)£> ((l^)k)| 2 ) 1/2 2 ri(1/2 - 1/?,) ) P >n d - 1 2 n ^- 1 ). (4.13) 

||s||l=»4 kep(s)\Km 

Relations (14.71) and (14.131) imply 

<v(W“’ 6 ) p » 2 n(1 - 1/p - a) n (d " 1)(b+1/p - 1) x mr a+ P (log m ) (d - 1 )(“+ 6 - 1 ). 


□ 

Consider a class W“’ 6 , which consists of functions / with a representation 

OO 

/ = £>*, t n G T(Q n ), \\t n \\ q <2- an n b{ - d ~ l \ 

n= 1 
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It is easy to see that in the case 1 < q < oo classes W“ ,b and W“ ,b are equiv¬ 
alent. Embedding of W“’ 6 into W“ ,fe is obvious and the opposite embedding 
follows from the inequality for / € W“ ,b 

ll/ill, = IKS® - .,)(/) II,« E IK"Hi« 

ri>l 

In the case q = 1 classes W“’ 6 are wider than W“’ fe . However, the results of 
this section hold for these classes as well. 

and \f.£\ hold for the class W“’ 6 instead of W“’ fc . 


Remark 4.1. Theorems f.l 


5 Discussion 

The effect of small smoothness in the behavior of asymptotic characteristics 
of smoothness classes was discovered by Kashin [7j in 1981. He proved that 
the rate of decay of the Kolmogorov widths d n (Wf,L p ) of the univariate 
classes Wf depends on r differently in the range 1 — 1/p < r < 1 (small 
smoothness) and in the range r > 1. Bclinskii [I] studied the univariate 
m-term trigonometric approximation and observed the small smoothness ef¬ 
fect in that setting. Romanyuk [10J conducted a detailed study of m- term 
trigonometric approximation of classes of multivariate functions with small 
mixed smoothness. The Besov classes are studied in [TO]. Define 

11/11^:= sup ||«5.(/)||,2’-IWIi > 


and for 1 < 9 < oo define 


\ i/0 

E(iiw)ii« 2r "'"‘)'j ■ 

We write B [ ;00 := H^. With a little abuse of notation, denote the corre¬ 
sponding unit ball 

:= {/: ||/||b ;># < 1}. 

In case of approximation in L p , 2 < p < oo, Lemma 11.11 was used in 
in- This makes the corresponding results in ra nonconstructive. We note 
that the bound for the m-term approximation error in Lemma 11.11 follows 
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from Theorem 11.11 and extra property 6 rn C 9 n in Lemma 11.11 follows from 
the proof of Theorem 11.11 in [16] . Thus, Theorem 11.11 makes Lemma 11.11 
constructive and, therefore, the nonconstructive results from |T0J, which are 
based on Lemma 11.11 are made constructive in this way. Also, the use of 
Theorem 11.11 is technically easier than the use of Lemma 11.11 For instance, 
in the proof of upper bounds in Theorem 13.11 we estimate ||5u|U in a rather 
simple way because of additivity property of the norm || • \\a and then apply 
Theorem 11.11 to g a ■ Typically, in [TO] Lemma 11.11 is applied to individual 
dyadic blocks S s (f) with m s depending on the norm of the S s (f). It would 
be interesting to see how much the technique, based on Theorem 11.11 could 
simplify the study of <j m (B' qd ) p . 

Let us make some comparison of our results on the W q classes with known 
results on e classes. It follows from Corollary 11.21 that for 1 < q < 2 we 
have 


B 9,2 ^ 


W r 

<? 


For example, in the case f3p' < r < 1/q Theorem 13.11 gives 


a m (W r q ) p x m -C-/3)p/2(i ogm )(<i- 1) (dp- 1) -^). ( 5 .i) 

The corresponding results from ra give 

<r m {B r qfi ) p x m -h-«p/2( logm )C-i)(h-i/?)(p-i)+i-i/0). ( 5 .2) 


In the case 9 = q the right hand sides of (15.ip and (15. 2 p coincide. This 
means that our results for a wider class imply the corresponding results 
for a smaller class B[ y . Relations (15. ip and (15. 2 p show that cr m (W r q ) p and 
cr m (B^ 2 ) p have different orders. 

As we already pointed out in the Introduction the main novelty of the pa¬ 
per is in providing constructive algorithms for optimal m-term trigonometric 
approximation on classes with small mixed smoothness. This is achieved by 
using Theorem ll.il The use of Theorem 1 1.1 1 is simpler than the use of Lemma 
11.11 traditionally used in this area of research. In addition to traditional use 
of Theorem 11.61 which goes back to papers [Lt] and [T2], we use other deep 
results from the hyperbolic cross approximation theory - Theorem 11.71 The¬ 
orem 11.81 and Lemma 14.21 We also prove a new result - Lemma 14.31 These 
results allowed us to treat the case q = 1 (see Section 4). 

A number of interesting unresolved problems on m-term trigonometric 
approximation is discussed in [16], Section 6. This paper makes a progress 




























in some of them. For instance, Theorems 11.21 and 13.61 cover the case /3p' < 
r < 1 jq for constructive m -term approximation of W” classes. The case 
(3 < r < f3p' is still open. There is no progress on small smoothness classes 
in the case 2 < q < p < oo. In the case q — 1 results presented in Section 4 
are optimal up to a factor (logm) e with arbitrarily small e > 0. It would be 
interesting to find right orders of cr m (W“’ h ) p and right orders of constructive 
m-term approximation of these classes. 

The reader can find a detailed discussion of greedy algorithms in Banach 
spaces in [T4j and their applications for the m-term trigonometric approxi¬ 
mation in j Q. [13], [15j, and [16]. 
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